Handwritten information inputting device and portable electronic apparatus including handwritten information inputting device

ABSTRACT

A handwritten information inputting device includes an inputting region into which handwritten information is inputted with a pointer such as an electronic pen or a finger. The device also includes a function disposition region in which a plurality of operational elements (e.g., graphic icons) are disposed, each assigned a process related to the inputted handwritten information such as enlarging or rotating the inputted handwritten information. In response to a continuous operation for a defined period of time of any of the operational elements, operational element disposition information regarding the operational elements disposed in the function disposition region is displayed on an external display apparatus, to which the handwritten information inputting device is connected. Also, the operated (selected) operational element is displayed visually distinguishable from the rest of the operational elements. Thus, an operator can confirm his operation of the operational elements without taking his eyes off the external display apparatus.

CROSS-REFERENCE TO RELATED APPLICATION

The present application claims priority under 35 U.S.C. 119(a) ofJapanese Application No. 2012-036910, filed Feb. 23, 2012, the entirecontent of which is incorporated herein by reference.

BACKGROUND

1. Technical Field

The present invention relates to a handwritten information inputtingdevice including a plurality of operational elements, each of which isassigned a defined function related to a process for handwritteninformation. The invention also relates to such a handwritteninformation inputting device configured to be connected to aninformation processing device coupled to a display apparatus or aninformation processing device incorporating a display screen. Theinvention further relates to a portable electronic apparatus includingsuch a handwritten information inputting device.

2. Description of the Related Art

As handwritten information inputting devices, digitizers and tabletdevices are known. Generally, a handwritten information inputting deviceis a coordinate inputting device connected to and used with aninformation processing device equipped with a display screen, such as acomputer connected to a display apparatus or a computer including adisplay screen, as disclosed in Patent Document 1 (Japanese PatentLaid-Open No. 2011-22661). In a handwritten information inputtingdevice, when a pointing input operation is carried out on a positiondetection plane configured to detect two-dimensional positioninformation of a position pointer, such as a pen-shaped pointer(hereinafter an “electronic pen”), a finger or the like, a positioncoordinate of the pointing input operation is detected and supplied tothe information processing device. The information processing devicegenerates, based on the position coordinate of the pointer's pointinginput operation received from the handwritten information inputtingdevice, image information corresponding to the handwritten input by thepointer and displays the image information on the screen of the displayapparatus.

Some of the handwritten information inputting devices of the typedescribed above include operational buttons or icons as operationalelements for executing various processing functions, such as to move,rotate, expand/reduce, scroll, or change the display color of ahandwritten or hand-drawn image displayed on a screen of a displayapparatus.

Conventionally, in order to cause a handwritten information inputtingdevice of the type described above to execute various processingfunctions described above, an operator of the handwritten informationinputting device must shift his/her line of sight from a state in whichthe operator is staring at the screen of an external display apparatusof the handwritten information inputting device to the handwritteninformation inputting device itself, and confirm and operate anoperational button of the handwritten information inputting device toinitiate the function assigned to the operational button.

It is cumbersome, however, for the operator to have to shift his/herline of sight from the state in which the operator is staring at thescreen of the external display apparatus to the handwritten informationinputting device itself each time the operator of the handwritteninformation inputting device wishes to operate an operational button toinitiate a defined processing function and, thus, the inputtingoperation described above is inefficient.

Patent Document 2 (Japanese Patent Laid-Open No. 2010-88069) disclosesan electronic apparatus including a remote control transmission deviceand an electronic apparatus main body having a display screen. Theremote control transmission device includes a touch sensor provided onthe surface of an operation key of the remote control transmissiondevice such that, when the touch sensor detects that the operation keyis touched, the electronic apparatus main body displays characters orthe like on the display screen corresponding to the function assigned tothe touched operation key. Specifically, in Patent Document 2, when thetouch sensor detects that the operation key is touched, the remotecontrol transmission device immediately transmits a remote controlsignal to the electronic apparatus main body to indicate that theoperation key is touched. When the electronic apparatus main bodyreceives the remote control signal, it determines which one of theoperation keys has been touched and recognizes a function assigned tothe determined operation key, and then displays the function on thescreen to alert the user.

PRIOR ART DOCUMENT Patent Document

Patent Document 1

-   Japanese Patent Laid-Open No. 2011-22661

Patent Document 2

-   Japanese Patent Laid-Open No. 2010-88069

BRIEF SUMMARY Problem(s) to be Solved by the Invention

Generally, when a plurality of operation keys are arrayed on a remotecontrol transmission apparatus, an operator often memorizes thepositions of the operation keys in the operation key array to search forand operate a desired operation key based on his memory. Specifically,if the operator is skilled in operating a particular apparatus whoseoperation key array is known to the operator, then the operator canperform typing without looking at the keys.

However, in the invention of Patent Document 2, only the text message(characters) indicating the processing function assigned to theoperation key touched by the operator is displayed on the displayscreen, and the operation key array itself is not displayed on thedisplay screen. In particular, in the case of the invention of PatentDocument 2, if an operation key is touched, then a processing functionassigned to the operation key is displayed, and therefore, even thoughthe processing function assigned to the touched operation key can beverified on the screen, the position of the operation key within the keyarray cannot be visually determined.

Therefore, if the touched operation key is not an operation key of anintended processing function, since the operation key array is notdisplayed on the screen, there is no aide or clue to search for adesired operation key, and the operator is forced to touch otherneighboring operation keys randomly to display processing functionsassigned to the other operation keys. Alternatively, to avoid suchrandom touching, the operator must move his line of sight from thedisplay screen to the operation key array of the remote controltransmission apparatus, search for the position of the desired operationkey, touch the operation key and then move the line of sight back to thedisplay screen to confirm a processing function assigned to theoperation key on the screen. Therefore, with the invention of PatentDocument 2 also, it is difficult to confirm and operate an operation keyhaving a desired processing function while maintaining the sight on thedisplay screen, and therefore the key operation may be inefficient.

Further, in the invention of Patent Document 2, since the operation keysare operation keys provided for the remote control transmissionapparatus, whenever the user touches any of the operation keys, the textmessage indicating a processing function assigned to the touchedoperation key is immediately displayed on the display screen.

In contrast, in the case of a tablet device or the like, the processingfunction of an operational button is to assist an input of handwritteninformation. Therefore, preferably a processing function is displayed onthe screen only when the user needs to view it, so as to avoid havingthe processing function display obstruct the display image ofhandwritten information. For example, when an operational button istouched in error or when the operator is skilled in operating theoperational button array and has memorized the functions of individualoperation keys, it is preferable not to display each function on thescreen every time an operational button is touched.

According to one aspect of the present invention, a handwritteninformation inputting device is provided, which makes it possible for anoperator to easily operate various operational elements without havingto move his eyes off of the screen of an external display apparatus and,further, makes it possible for the operator to visually confirm, asoccasion demands, an operational function of an operational elementrelated to a process for handwritten information.

Means for Solving the Problem

In order to solve the problems described above, according to an aspectof the present invention, there is provided a handwritten informationinputting device connected to an information processing device, to whicha display apparatus is connected. The handwritten information inputtingdevice includes:

a handwritten information inputting region, into which handwritteninformation corresponding to an operation of a pointer is to beinputted, and

a function disposition region, in which a plurality of operationalelements are disposed, wherein each operational element is assigned aprocess for handwritten information inputted by an operation of thepointer in the handwritten information inputting region;

wherein the handwritten information inputting device and the informationprocessing device cooperate with each other such that, in response to acontinuous operation for a defined period of time of any of theoperational elements disposed in the function disposition region,operational element disposition information of the operational elementsdisposed in the function disposition region is displayed on the displayapparatus to visually distinguish the operated operational element fromthe operational elements other than the operated operational element.

In the handwritten information inputting device according to the presentinvention having the configuration described above, if any of theplurality of operational elements assigned with the processes forhandwritten information is operated continuously for the defined timeperiod, then the operational element disposition information of theplurality of operational elements disposed in the function dispositionregion is displayed on the screen of the external display apparatus.Further, on the display screen, the operated operational element and theoperational elements other than the operated operational element aredisplayed such that they can be visually distinguished from each other.

Accordingly, according to an aspect of the present invention, since theoperational element disposition information of the plurality ofoperational elements disposed in the function disposition region aredisplayed on the display screen, the user can easily recognize from thedisplay screen which one of the operational elements in the operationalelement array is the operated operational element and, furthermore, evenif the operated operational element is not an operational elementintended by the user, the user can readily recognize a desiredoperational element from the operational element disposition informationwithout looking away from the display screen.

Accordingly, the user can recognize a desired operational element bylooking only at an image displayed on the screen of the external displayapparatus without moving the line of sight away from the display screenof the external display apparatus, and therefore can initiate a desiredprocessing function necessary for his/her handwritten input.

Furthermore, according to an aspect of the present invention, only whenit is detected that an operation of an operational element has continuedfor the defined time period, is the operational element dispositioninformation regarding the plurality of operational elements displayed onthe screen of the external display apparatus. This is because, if theoperational element disposition information is displayed on the displayscreen in response to merely a brief or momentary operation of anoperational element, then the operational element dispositioninformation is unnecessarily displayed even when an operational elementis inadvertently or erroneously operated. In contrast, according to anaspect of the present invention, it is possible to reflect the trueintent of the operator with respect to the plurality of operationalelements disposed in the function disposition region, with theoperational element disposition information displayed on the displayscreen.

Therefore, even when the operational element disposition information isto be displayed over a relatively large display area, since theoperational element disposition information is not unnecessarilydisplayed on the display screen, it is possible to avoid unnecessarilyobstructing a main image of handwritten information displayed on thedisplay screen.

Effects of the Invention

According to the present invention, a technical effect is achieved thata user can carry out an operation of an operational element for aprocess related to handwritten information without having to take hiseyes off the display screen of the external display apparatus. Also, itbecomes possible to avoid unnecessary obstruction of an image ofhandwritten information.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 is a view illustrating a sample configuration of an appearance ofan embodiment of an electronic apparatus according to the presentinvention.

FIG. 2 is a view illustrating a sample use of an embodiment of theelectronic apparatus according to the present invention.

FIGS. 3A to 3C are views each illustrating a sample configuration of anoperational element in an embodiment of the electronic apparatusaccording to the present invention.

FIG. 4 is a block diagram illustrating a sample configuration of acircuit section of an embodiment of the electronic apparatus accordingto the present invention.

FIGS. 5 and 6 each show a portion of a flow chart of a processingoperation of an embodiment of the electronic apparatus according to thepresent invention.

FIGS. 7A and 7B are views each showing a sample display on a screen ofan external display apparatus, to which image information is suppliedfrom an embodiment of the electronic apparatus according to the presentinvention.

FIGS. 8A and 8B are views each showing a sample display on a screen ofan external display apparatus, to which image information is suppliedfrom an embodiment of the electronic apparatus according to the presentinvention.

FIG. 9 is a view illustrating a sample use of a different embodiment ofthe electronic apparatus according to the present invention.

FIG. 10 is a block diagram illustrating a sample configuration of adifferent embodiment of the electronic apparatus according to thepresent invention.

FIG. 11 is a flow chart of a processing operation of a differentembodiment of the electronic apparatus according to the presentinvention.

FIG. 12 is a view illustrating a sample configuration of a sensorsection used in a different embodiment of the electronic apparatusaccording to the present invention.

FIGS. 13-15 are each show a portion of a flow chart of a processingoperation of a different embodiment of the electronic apparatusaccording to the present invention.

DETAILED DESCRIPTION First Embodiment

A first embodiment of a handwritten information inputting deviceaccording to the present invention is described as a tablet device, onwhich handwritten inputting can be carried out using a pointer such asan electronic pen or a finger for writing characters or drawing apicture.

FIG. 1 is a view showing an appearance of a tablet device as an exampleof the handwritten information inputting device of the presentembodiment. A housing of the tablet device 1 has an outer profilegenerally in the form of a thin plate and is configured from an uppercase 1 a and a lower case (not shown). FIG. 1 is a view of the uppercase 1 a as viewed from above. On the surface of the upper case 1 a, ahandwritten information inputting region 2 for detecting a handwrittenoperation input by an electronic pen (position pointer), which forms apointer, and an operation switch section 3 are provided. The operationswitch section 3 forms a function disposition region and has a pluralityof operational elements arrayed thereon, as shown in the figure and ashereinafter described.

The tablet device 1 of the present example is connected to and usedtogether with a personal computer 100 as an example of an informationprocessing device connected to a display apparatus 101, as shown in FIG.2. The personal computer 100 includes a program therein, for cooperatingwith the tablet device 1 to produce image information to be displayed ona display screen 101D of the display apparatus 101. In the example ofFIG. 2, the tablet device 1 is connected by wireless connection to thepersonal computer 100 and is configured such that a character or apicture inputted with a pointer, such as an electronic pen or a finger,in the handwritten information inputting region 2 of the tablet device 1is displayed on the display screen 101D of the display apparatus 101connected to the personal computer 100.

For the wireless connection between the tablet device 1 and the personalcomputer 100, in the present example, the Bluetooth (registeredtrademark) standards technology is used. If a defined button (not shown)for wireless connection is operated, then the tablet device 1 searchesfor a personal computer 100 that is ready for wireless connectionaccording to the Bluetooth standards and carries out, if such a personalcomputer 100 is located, a process (referred to as a “pairing process”)for establishing a mutual connection to place both of them into a statein which they can communicate by wireless communication with each other.It is to be noted that the personal computer 100 determines whether theaspect ratio of the display screen 101D of the display apparatus 101connected to the personal computer 100 is 4:3 or 16:9 based oninformation received from the display apparatus 101 and stored in thepersonal computer 100.

As hereinafter described, the personal computer 100 produces imageinformation of a character or a picture drawn by a pointer, such as anelectronic pen or a finger, based on information received from thetablet device 1 such that the aspect ratio is, for example, 4:3. Then,when the aspect ratio of the display screen 101D of the displayapparatus 101 is 4:3, the personal computer 100 supplies the producedimage information “as is” to the display apparatus 101. However, whenthe aspect ratio of the display screen 101D of the display apparatus 101is 16:9, the personal computer 100 supplies the produced imageinformation as image information in the format type of a pillar box (ora side panel) wherein dark frames are added to the left and right sidesof an image of 4:3.

It is to be noted that the wireless connection between the tablet device1 and the personal computer 100 is not limited to that according to theBluetooth standards, and of course other technologies such as the WiFi(registered trademark: wireless fidelity) and other wireless connectionmethods can be used. Further, the tablet device 1 and the personalcomputer 100 may be configured such that they are connected by a wireconnection by means of a cable. Further, the personal computer 100 andthe display apparatus 101 may be connected to each other by wirelessconnection, and the personal computer 100 and the tablet device 1 may beconfigured as a single apparatus wherein they are integrally formed andaccommodated in the same housing.

The tablet device 1 of the present example is configured such that, asshown in FIG. 2, in the handwritten information inputting region 2,position pointing by an electronic pen 10 can be detected and alsoposition pointing by a finger 11 can be detected. To this end, thoughnot shown, a sensor section of the electromagnetic induction type fordetecting a pointing input by the electronic pen 10 and another sensorsection of the capacitive type for detecting a pointing input by thefinger 11 are provided in the housing below the handwritten informationinputting region 2.

The configuration of the sensor section of the electromagnetic inductiontype is well known and disclosed, for example, in a patent document(Japanese Patent Laid-Open No. 2009-3796) and so forth, and therefore,detailed description of the same is omitted. Briefly, the sensor sectionincludes a sensor substrate (not shown) having, for example, an X-axisdirection loop coil group and a Y-axis direction loop coil group formedthereon, and sends an output signal corresponding to the (X, Y)coordinate position pointed to or operated on by the electronic pen 10.

Meanwhile, the configuration of the sensor section of the capacitivetype is also well known and disclosed, for example, in another patentdocument (Japanese Patent Laid-Open No. 2011-3035), and therefore,detailed description of the same is omitted. Briefly, a conductorpattern of a matrix configuration is provided, wherein a plurality ofconductors for signal transmission and a plurality of conductors forsignal reception cross each other. The level of a reception signal isdetected, which varies in response to a variation of the capacitancebetween a conductor for signal transmission and a conductor for signalreception, toward which a finger is approaching or touching. Based onthe detected level of a reception signal, an output signal correspondingto the (X, Y) coordinate position pointed to by the finger is generatedand outputted.

The sensor section of the capacitive type and the sensor section of theelectromagnetic induction type are provided in a superposed relationshipon each other in a direction perpendicular to the inputting face of thehandwritten information inputting region 2. In this instance, normallythe sensor section of the capacitive type is placed on the sensorsection of the electromagnetic induction type, and the inputting face ofthe handwritten information inputting region 2 is disposed on the sensorsection of the capacitive type.

In the tablet device 1 as the electronic apparatus of the firstembodiment, the operation switch section 3 is provided laterally of thehandwritten information inputting region 2 of the upper case 1 a of thetablet device 1, as shown in FIGS. 1 and 2. In the present example, theoperation switch section 3 includes a plurality of operation switchesfor carrying out operation control of auxiliary processing functionswhen a character or a picture is drawn by a pointer such as theelectronic pen 10. In the present example, the operation switches areused as operational elements also to control the operation of the tabletdevice 1 itself. In the present example, nine operational elementsincluding a circular operation region 3R disposed at a central portionof the operation switch section 3 are juxtaposed in a row in a verticaldirection.

Referring to FIG. 1, in the present example, operation regions 3A, 3B,3C, 3C, 3E, 3F, 3G, 3H and 3R that form the individual operationalelements are disposed in the operation switch section 3. The operationregions 3A to 3H include quadrangular operation regions, and theoperation region 3R includes a circular operation region. The operationswitch section 3 has an operational element array wherein the circularoperation region 3R is positioned at the center of the array in thevertical direction and the four operation regions 3A to 3D aresuccessively juxtaposed above the circular operation region 3R while thefour operation regions 3E to 3H are successively juxtaposed below thecircular operation region 3R.

The present embodiment is configured such that, as hereinafterdescribed, if a user touches any of the operation regions 3A to 3H and3R with the finger 11, then the touch can be detected by the capacitivetype method. Further, the operation regions 3A to 3H and 3R are eachconfigured such that, if the user presses the same with the finger 11,then a push switch provided on an operation switch circuit boarddisposed in the housing is depressed as the operation region(thereabove) is deflected in an inward direction into the housing of thetablet device 1, to thereby carry out a switch operation. The pushswitches and the operation regions 3A to 3H and 3R together formoperational elements.

It is to be noted that the circular operation region 3R is configuredfrom a central operation region 3Ra, and a ring-shaped touch wheeloperation region 3Rb positioned around the central operation region 3Ra.The push switch provided relative to the circular operation region 3R isprovided not only beneath the central operation region 3Ra but alsobeneath the touch wheel operation region 3Rb at upper, lower, left andright positions of the touch wheel operation region 3Rb, indicated bytriangular marks in FIG. 1. In the present example, to detect a tracingoperation on or over the touch wheel operation region 3Rb in acircumferential direction, though not shown, a rotational positiondetection sensor for detecting a rotating operation is further providedbeneath the touch wheel operation region 3Rb.

The operation switch section 3 is constructed of an operation platesection 30 formed as a part separate from the upper case 1 a, and anoperation switch circuit board (hereinafter referred to simply ascircuit board) provided in the housing of the tablet device 1 on thelower face side of (beneath) the operation plate section 30. Theoperation regions 3A to 3H and 3R are provided on the operation platesection 30. The operation regions 3A to 3H and 3R are configuredsimilarly to each other except that the operation region 3R is differentfrom the operation regions 3A to 3H in that it has a circular shape.Therefore, in the following description, a sample configuration of theoperation region 3B is described as an example of an operationalelement.

FIGS. 3A to 3C are views illustrating a sample configuration of theoperation region 3B as a sample operational element. FIG. 3A shows aportion of the operation plate section 30 of the operation region 3B asviewed from within the housing, FIG. 3B shows the circuit board on thelower side of the operation region 3B, and FIG. 3C is a cross-sectionalview taken along line X-X of FIG. 1.

The operation plate section 30 is formed, for example, from resin, andconfigured from a plate-like member 31, as shown in FIG. 3A. Aprotective sheet member 32 (see FIG. 3C) is provided, to cover thesurface 30 a side (see FIG. 1) and side portions of the operation platesection 30 of the plate-like member 31.

As shown in FIGS. 3B and 3C, a touch detection electrode 6B that formsthe sensor section of the capacitive type is disposed as a conductorpattern printed on a face 4 a of a circuit board 4 that is facing theoperation region 3B, so as to correspond and oppose to the operationregion 3B of the operation plate section 30.

The touch detection electrode 6B is formed as a conductor pattern spacedfrom and above the circuit board 4 such that it does not electricallyconnect to other adjacent touch detection electrodes 6A and 6C. Further,the touch detection electrode 6B is connected, via a through-hole (notshown) to a conductor pattern formed on a face 4 b of the circuit board4 opposite to the face 4 a thereof, to a touch detection circuit (IC(Integrated Circuit)) of the capacitive type, as will be describedbelow.

At a substantially central position of the touch detection electrode 6Bof the circuit board 4, a region 61B having no conductor pattern isprovided, and a push switch 5B is disposed in the region 61B. The pushswitch 5B includes a movable portion 51B exposed to the outside andmovable in response to depression thereof, as seen in FIGS. 3B and 3C.The push switch 5B changes its switch state when the movable portion 51Bis depressed.

The push switch 5B in the present embodiment includes a metal frame 52Bat an outermost peripheral portion thereof, and in order to utilize thismetal frame 52B also as part of the touch detection electrode 6B, theground terminal 53B of the push switch 5B is soldered not to a groundingconductor but to the touch detection electrode 6B, to thereby establishan electric connection.

In this instance, switch terminals of the push switch 5B areelectrically connected, by soldering, to wiring lines (not shown)disposed on the circuit board 4 in this region 61B. On the face 4 b sideof the circuit board 4, a switch state detection circuit (IC) fordetecting an on/off state of the push switch 5B is provided, and thepush switch 5B is connected to the switch state detection circuitthrough the wiring lines described above.

In the present example, as the push switch 5B, a switch (push switch) ofthe product number EVPAA102K by Panasonic Electronic Devices Co., Ltd.is used as an electronic part (finished part), for example. This pushswitch is small in size in that the outer size thereof islength×width×height=3.5 mm×2.9 mm×1.7 mm.

It is to be noted that, on the face 4 a of the circuit board 4, a groundelectrode 6GNDa formed from a conductor pattern is disposed so as tosurround a plurality of touch detection electrodes including the touchdetection electrode 6B, such that touch detection by the touch detectionelectrode 6B can be carried out more stably based on the groundelectrode 6GNDa. It is to be further noted that, on the face 4 b of thecircuit board 4, a ground electrode 6GNDb (see FIG. 3C) formed from aconductor pattern is disposed substantially over the entire area in thepresent example.

Meanwhile, in the plate-like member 31, a through-hole 310B of a sizecorresponding to the operation region 3B is formed. In FIG. 3C,through-holes 310A and 310C corresponding to the operation regions 3Aand 3C are shown.

The protective sheet member 32 is bonded to the upper face of theplate-like member 31 by a bonding agent so as to cover the through-holes310A, 310B, 310C, and so on. The protective sheet member 32 is, in thepresent example, a dielectric elastic material having a dielectricconstant higher than those of the air and the plate-like member 31. Theprotective sheet member 32 is formed from a sheet member made of, forexample, dielectric rubber.

Accordingly, in the operation plate section 30, the region in which thethrough-hole 310B of the plate-like member 31 is formed, that is, theoperation region 3B, exhibits a state in which only the protective sheetmember 32 exists. Therefore, if the user pushes the operation region 3Bwith the finger 11 from the surface 30 a side of the operation platesection 30, then the protective sheet member 32 is biased to bedeflected to the inner side of the housing of the tablet device 1through the through-hole 310B of the plate-like member 31.

In this instance, as shown in FIG. 3C, an annular (surrounding) rib 311Bof a defined height h1 (see also FIG. 3A) is formed in an implantedmanner on a circumferential portion of the through-hole 310B on the rearface 31 b side (see FIG. 3A) of the plate-like member 31. This annularrib 311B has a role of separating the operation region 3B from theoperation region 3A or the operation region 3C disposed adjacentthereto, and another role of a spacer for spacing the circuit board 4and the operation plate section 30 from each other by the height h1.FIG. 3C also shows annular ribs 311A and 311C, which are formed in animplanted manner on circumferential portions of the through-holes 310Aand 310C of the operation regions 3A and 3C positioned adjacent to theoperation region 3B.

It is to be noted that, in the present example, at a portion of theprotective sheet member 32 formed of a dielectric elastic materialcorresponding to the through-hole 310B of the plate-like member 31, arib 321B is formed, for example, along a contour shape of the operationregion 3B. The height h2 of this rib 321B is lower than the height h1 ofthe annular rib 311B formed on the rear face side of the plate-likemember 31, as in h1>h2.

Since the distance between the protective sheet member 32 formed from adielectric elastic material and the touch detection electrode 6B isessentially maintained short due to the presence of the rib 321B, thethickness of the air layer between the peripheral portion of the pushswitch 5B and the touch detection electrode 6B is reduced and thedielectric constant of the operation region 3B becomes greater than thedielectric constant of other region(s) of the operation plate section30. Consequently, the capacitance between the touch detection electrode6B and the finger 11 of the user that is touching the operation region3B can be increased, and the detection sensitivity of a touchingoperation can be improved. It is to be noted that, FIG. 3C also showsribs 321A and 321C formed on the protective sheet member 32 in theoperation regions 3A and 3C positioned adjacent to the operation region3B.

At the center of the rib 321B formed on the protective sheet member 32,a protrusion 322B is formed for surely pressing the movable portion 51Bof the push switch 5B.

In the present embodiment, the operation plate section 30 is positionedand disposed in a superposed relationship on the circuit board 4 suchthat the centers of the operation regions 3A to 3H and 3R correspond tothe positions of the centers of the touch detection electrodes 6A to 6Hand 6R of the circuit board 4, respectively, and the operation platesection 30 and the circuit board 4 are coupled to each other to form theoperation switch section 3.

As shown in FIG. 3C, when the finger 11 of the user is in a state inwhich it lightly touches the surface of the protective sheet member 32of the operation region 3B, the movable portion 51B of the push switch5B is in a state in which it is not depressed. However, at this time, itis detected by the touch detection circuit 7 as shown in FIG. 4, towhich the touch detection electrodes (6A to 6R) are connected, that thefinger 11 is touching the operation region 30B. In FIG. 3C, since themetal frame 52B of the push switch 5B is connected to the touchdetection electrode 6B through the ground terminal 53B, this portion ofthe metal frame 52B functions as part of an electrode for detecting atouch of the finger 11. Accordingly, if the operation region 30B istouched by the finger 11, then the touch can be detected with a highsensitivity.

If a user presses the operation region 3B with the finger 11 in thestate of FIG. 3C, then the protective sheet member 32 made of dielectricrubber as a dielectric elastic material is deflected to depress themovable portion 51B of the push switch 5B. Consequently, in the pushswitch 5B, a dome-shaped electrode 54B forming the switch is deflecteddownwardly by the movable portion 51B to establish a state in which itis connected to the other electrode 55B of the switch. If, in thisstate, the pressing force by the finger 11 is removed, then thedome-shaped electrode 54B of the switch is restored to its originalstate to undo the connection to the other electrode 55B.

In the present embodiment, if the operation region 3B is touched by thefinger 11, then the touch is detected by the touch detection electrode6B as described above. Then, if the operation region 3B is pressedcontinuously by the finger 11, then the switch state of the push switch5B is changed, and the depression operation is detected. A touchingoperation and a depression operation of the finger 11 can be detectedsimilarly with regard to the other operation regions 3A, 3C to 3H and3R, also.

In the tablet device 1 of the present embodiment, depression operationsof the operation regions 3A to 3H and 3R are assigned with variousfunctions related to pointing input by a pointer to the handwritteninformation inputting region 2. The user can select functions he or shewishes to use from among many functions, and then assign each theselected functions to a depression operation of any of the operationregions 3A to 3H and 3R. The assignment of the functions to thedepression operations of the operation regions 3A to 3H and 3R can becarried out in advance.

The functions assignable to the depression operations of the operationregions 3A to 3H and 3R may include, for example, displaying a set menu,switching between various modes, returning to the immediately precedingstep, and enlargement, reduction, movement, rotation, scroll and soforth of a character or a picture displayed on the screen.

As described hereinabove, if the user carries out position pointinginput operation by means of a pointer such as the finger 11 or theelectronic pen 10 in the handwritten information inputting region 2,then the tablet device 1 of the present embodiment detects the pointedinput position and sends the detected coordinate to the personalcomputer 100. The personal computer 100 produces image informationcorresponding to handwritten input information based on the detectedcoordinate received from the tablet device 1 and displays the producedimage information on the display screen 101D of the display apparatus101.

Accordingly, the user can carry out desired drawing input by operating apointer in the handwritten information inputting region 2 of the tabletdevice 1 while watching the image displayed on the display screen 101Dof the display apparatus 101. Further, according to an aspect of thepresent invention, whichever one of the operation regions 3A to 3H and3R that form the function disposition region is operated, desiredfunctions assigned to depression operations of the operation regions 3Ato 3H and 3R can be displayed on the display screen 101D of the displayapparatus 101. Therefore, the user can confirm contents of a process tobe executed by a desired depression operation without having to move hisline of sight from the display screen 101D of the display apparatus 101.

FIG. 4 shows an example of an internal circuit configuration of thetablet device 1 as the electronic apparatus of the first embodiment. Asshown in FIG. 4, the tablet device 1 of the present embodiment includesa touch detection circuit 7, a switch state detection circuit 8 fordetecting a depression state of a push switch, a sensor section 91 ofthe electromagnetic induction type, a position detection circuit 92 fordetecting a position pointing input by the electronic pen 10 as apointer to the sensor section 91 of the electromagnetic induction type,a sensor section 93 of the capacitive type, a position detection circuit94 for detecting a position pointing input by the finger 11 as a pointerto the sensor section 93 of the capacitive type, a wireless connectioncircuit 95 for wirelessly connecting to an information processing devicesuch as the personal computer 100, and a control circuit 90. To thecontrol circuit 90, the touch detection circuit 7, switch statedetection circuit 8, position detection circuits 92 and 94 and wirelessconnection circuit 95 are connected.

As described above, the wireless connection circuit 95 in the presentembodiment is a circuit for establishing a wireless connection, forexample, in accordance with the Bluetooth standards to an informationprocessing device such as the personal computer 100. In response to anoperation of a button (not shown), the control circuit 90 controls thewireless connection circuit 95 to carry out a search for an apparatusavailable for wireless connection in accordance with the Bluetoothstandards. Then, if an information processing device available forwireless connection is detected, the wireless connection circuit 95carries out wireless connection to the information processing device.

The sensor section 91 of the electromagnetic induction type detects apointing input by the electronic pen 10. Then, the pointing input by theelectronic pen 10 detected by the sensor section 91 is supplied to theposition detection circuit 92, which detects a coordinate value of thepointed position. Then, the position detection circuit 92 supplies thedetected coordinate value to the control circuit 90. The control circuit90 transmits the received coordinate value to the personal computer 100connected by wireless connection through the wireless connection circuit95.

Meanwhile, the sensor section 93 of the capacitive type detects apointing input by the finger 11. Then, the pointing input by the finger11 detected by the sensor section 93 is supplied to the positiondetection circuit 94, which detects the coordinate value of the pointedposition. Then, the position detection circuit 94 supplies the detectedcoordinate value to the control circuit 90. The control circuit 90transmits the received coordinate value to the personal computer 100through the wireless connection circuit 95.

The personal computer 100 includes an image information productioncircuit 110 as a functional element implemented by software, forexample. The image information production circuit 110 produces an imageof a locus or the like in response to a pointing input by a pointer suchas the electronic pen 10 or the finger 11, based on a coordinate valueand information of time at which the coordinate value is received. Inthis instance, the personal computer 100 determines an aspect ratio ofthe display apparatus 101 through communication with the displayapparatus 101, and stores the aspect ratio in advance. Then, thepersonal computer 100 causes the image information production circuit110 to produce an image of a locus or the like, in response to thepointing input by the pointer such as the electronic pen 10, in theaspect ratio of 4:3, for example, in accordance with a correspondingimage display standard.

Then, the personal computer 100 supplies the produced image informationto the display apparatus 101 so that the image information is displayedon the display screen 101D.

The touch detection circuit 7 includes touch detection circuit sections7A to 7H and 7R (hereinafter referred to as touch detection circuitsections 7A to 7R) for detecting a touch of the finger 11 with theoperation regions 3A to 3H and 3R corresponding to the touch detectionelectrodes 6A to 6H and 6R, respectively, as part of the capacitive typesensor. The touch detection circuit sections 7A to 7R all have the sameconfiguration and include a pointer detection controlling circuit 71, atransmission signal supplying circuit 72, a reception amplifier 73 and areception level detection circuit 74.

In each of the touch detection circuit sections 7A to 7R, thetransmission signal supplying circuit 72 outputs a transmission signal,for example, in the form of an ac signal of a defined frequency inaccordance with a control instruction of the pointer detectioncontrolling circuit 71. Such transmission signals are supplied to thetouch detection electrodes 6A to 6R. Further, the transmission signalsare inputted to the reception level detection circuit 74 through therespective reception amplifiers 73.

With respect to each of the operation regions 3A to 3R, if the finger 11of the user does not touch the same, then the input signal to thereception level detection circuit 74 is a signal of a defined level Encorresponding to the signal level of the transmission signal, and thereception level detection circuit 74 detects the defined level En andoutputs the same to the pointer detection controlling circuit 71.

On the other hand, with respect to any of the operation regions 3A to3R, if the finger 11 of the user touches the same, then part of thetransmission signal supplied to a corresponding one of the touchdetection electrodes 6A to 6R flows to the ground through the human bodyvia a capacitor formed between the finger 11 and the touch detectionelectrode (6A to 6R) touched by the finger 11. Therefore, if the finger11 touches a touch electrode, then the level of the input signal to thereception level detection circuit 74 varies to a low level Es ascompared to that when the finger 11 does not touch the electrode.Accordingly, the reception level detection circuit 74 detects the signalvariation to the low level Es and outputs the same to the pointerdetection controlling circuit 71.

The pointer detection controlling circuit 71 compares the level outputfrom the reception level detection circuit 74 with a threshold level Eth(En>Eth>Es) determined in advance and detects, when the level outputfrom the reception level detection circuit 74 is lower than thethreshold level Eth, that the finger 11 of the user is touching theoperation region (3A to 3R). Otherwise, the pointer detectioncontrolling circuit 71 detects that the finger 11 is not touching anoperation region and outputs the detection result.

Each of the touch detection circuit sections 7A to 7R outputs thedetection output of the pointer detection controlling circuit 71 as atouch detection output TA to TR, related to a corresponding one of theoperation regions 3A to 3R, to the control circuit 90.

It is to be noted that, where transmission signals from the transmissionsignal supplying circuits 72 of the touch detection circuit sections 7Ato 7R are signals of the same frequency, the transmission signals fromthe transmission signal supplying circuits 72 are suppliedtime-divisionally so that the output timings of the transmission signalsfrom the transmission signal supplying circuits 72 of the touchdetection circuit sections 7A to 7R do not overlap with each other. Onthe other hand, it is also possible to supply the transmission signalsfrom the transmission signal supplying circuit 72 of the touch detectioncircuit sections 7A to 7R at the same time by forming the transmissionsignals from the transmission signal supplying circuits 72 of the touchdetection circuit sections 7A to 7R as signals of different frequenciesor as signals of different codes.

Further, switch output signals of the push switches 5A to 5R disposed onthe circuit board 4 are supplied to the switch state detection circuit8. When one of the push switches 5A to 5R is depressed by the finger 11to change the switch state, the switch state detection circuit 8supplies information identifying the depressed push switch to thecontrol circuit 90. Also, when a plurality of the push switches 5A to 5Rare depressed simultaneously, the switch state detection circuit 8 candetect which ones of the push switches are depressed simultaneously.

The control circuit 90 transmits touch detection outputs TA to TRreceived from the touch detection circuit 7 and information identifyinga depressed push switch received from the switch state detection circuit8 to the personal computer 100 through the wireless connection circuit95.

When the personal computer 100 receives touch detection outputs TA to TRand information identifying a depressed push switch from the tabletdevice 1, it carries out processing, for example, in accordance withflow charts shown in FIGS. 5 and 6.

Referring to FIGS. 5 and 6, the personal computer 100 first monitors thetouch detection outputs TA to TR and determines whether or not a finger11 has touched any of the operation regions 3A to 3R (step S1). If thepersonal computer 100 determines at step S1 that none of the operationregions 3A to 3R is touched, then the personal computer 100 executes adifferent process (step S2).

On the other hand, if it is determined at step S1 that one of theoperation regions 3A to 3R is touched, then the personal computer 100determines whether or not a defined time period T1, for example, T1=500msec, has elapsed after the touch (step S3). If it is determined at stepS3 that the defined time period T1 has not elapsed, then the personalcomputer 100 determines whether or not the touch is continuing (stepS4). If it is detected that the touch is not continuing or the finger 11is removed from one of the operation regions 3A to 3R, then the personalcomputer 100 determines that a touch was not intended by the user, andreturns to step S1.

On the other hand, if it is detected at step S4 that the touch iscontinuing, then the personal computer 100 determines whether or not apush switch immediately below (beneath) the operation region beingtouched is depressed (step S5). If it is decided at step S5 that thepush switch is not depressed, then the personal computer 100 returns theprocessing to step S3, at which it monitors the lapse of time of thedefined time period T1 after the touch. On the other hand, if it isdetected at step S5 that the push switch is depressed, then the personalcomputer 100 starts a function assigned to an operation regioncorresponding to the depressed push switch and then advances theprocessing to a processing routine of the function (step S6).

On the other hand, if it is detected at step S3 that the defined timeperiod T1 has elapsed after the touch, then the personal computer 100causes the image information production circuit 110 to synthesize imageinformation (i.e., operational element disposition information)representative of the operation switch array of the operation switchsection 3, as well as the image information produced in response to thepointing input to the handwritten information inputting region 2, andsupplies all of the produced image information to the display apparatus101 so that the image information is displayed on the display screen101D (step S7).

In this instance, the operational element disposition information isimage information indicating the plurality of operation regions 3A to 3Hand 3R of the operation switch section 3, which is the functiondisposition region of the tablet device 1, and how they are arrayedrelative to each other. Further, in the present example, the operationalelement disposition information includes textual display of functionsassigned to the operation regions 3A to 3R, as shown in FIGS. 7A and 7B.Further, in this instance, the operational element dispositioninformation displayed on the display screen 101D indicates whichoperation region is selected by, for example, displaying the touched andselected operation region in a different color or in different displayluminance as compared to other non-selected operation regions, so thatthe user can readily determine that this touched operation region is ina selected state.

As shown in FIG. 7A, when the display screen 101D of the displayapparatus 101 has an aspect ratio of 4:3, the image informationproduction circuit 110 of the personal computer 100 produces an imageIDX of the operational element disposition information, which isoverlay-displayed on an input image Px (whose aspect ratio is 4:3)produced in response to the pointing input to the handwritteninformation inputting region 2. In this instance, the image IDX of theoperational element disposition information, which is overlay-displayedon the input image Px, is made transparent at a portion other than theportion that is explicitly displayed as the operational elementdisposition information (on the left-hand side in FIG. 7A), so that theinput image Px can be visually confirmed in the display screen 101D, asshown in FIG. 7A.

As shown in FIG. B, on the other hand, if the stored aspect ratio of thedisplay screen 101D of the display apparatus 101 is 16:9, then the imageinformation production circuit 110 processes the image information ofthe input image Px (whose aspect ratio is 4:3) in response to thepointing input to the handwritten information inputting region 2, suchthat the image Px is displayed in the right-hand side region Ap of thedisplay screen 101D while the left-hand side region of the displayscreen 101D is displayed as a black frame region Abl. Then, the imageinformation production circuit 110 produces an image IDX of theoperational element disposition information so that it is displayed inthe left-hand side black frame region Abl of the display screen 101D,and synthesizes the image IDX with the image information of the inputimage Px. Accordingly, in the case of FIG. 7B, since the input image Pxand the image IDX of the operational element disposition information donot overlap with each other, even if the image IDX of the operationalelement disposition information is displayed on the display screen 101D,the user can always view the entire input image Px unobstructed by theimage IDX of the operational element disposition information.

Further, in both of the cases of FIGS. 7A and 7B, in the image IDX ofthe operational element disposition information, a portion displayed onthe display screen 101D corresponding to an operation region that hasbeen continuously touched for more than the defined time period T1 bythe user (in the present embodiment, the operation region 3E that isassigned a function of “Shift”) is distinctively displayed, for examplein a thicker frame, in a different color, displayed flickering, ordisplayed in a somewhat greater size, etc., so that the user can readilydetermine that this operation region is currently selected. In theexample of FIGS. 7A and 7B, the rectangular frame for the operationregion 3E is shown thick so as to inform the user that the operationregion 3E is currently selected.

When the image IDX of the operational element disposition information isdisplayed on the display screen 101D of the display apparatus 101 asdescribed above, the personal computer 100 monitors whether or not adifferent operation region of the operation switch section 3 is touched(step S8). Then, if it is determined at step S8 that a differentoperation region of the operation switch section 3 is touched, then thepersonal computer 100 moves the distinctive display described above to adisplay portion corresponding to the different operation region that isnewly touched, so that the user can tell that the different operationregion is currently selected (step S9). Then, the personal computer 100returns the processing to step S8.

On the other hand, if it is detected at step S8 that a differentoperation region of the operation switch section 3 is not touched, thenthe personal computer 100 determines whether or not the touch on thetouched operation region is continuing (step S11 of FIG. 6). If it isdetected at step S11 that the touch is continuing, then the personalcomputer 100 determines whether or not a push switch immediately beneaththe touched operation region is depressed (step S12).

If it is determined at step S12 that the push switch is depressed, thenthe personal computer 100 stops sending the image IDX of the operationalelement disposition information to the display apparatus 101 (step S13).Thereafter, the personal computer 100 starts a function assigned to thedepressed push switch and advances to a processing routine of thefunction (step S14).

On the other hand, if it is determined at step S12 that the push switchis not depressed, then the personal computer 100 monitors whether or nota defined time period T3, for example, T3=3 seconds, has elapsed afterthe last touch detection on an operation region (step S15). If it isdetermined that the defined time period T3 has not elapsed, then thepersonal computer 100 returns the processing to step S11. On the otherhand, if it is determined at step S15 that the defined time period T3has elapsed after the touch on an operation region, then the personalcomputer 100 instructs the image information production circuit 110 tostop the production of the image IDX of the operational elementdisposition information to stop sending the image IDX of the operationalelement disposition information to the display apparatus 101 (step S16).Then, the personal computer 100 returns the processing to step S1 torepeat the processes of the steps beginning with step S1.

On the other hand, if it is determined at step S11 that the touch is notcontinuing and the finger 11 is moved away from the operation region,then the personal computer 100 determines whether or not a defined timeperiod T2, for example, T2=800 msec, has elapsed after the time at whichthe finger 11 is moved away from the operation region (disappearance ofthe touch) (step S17). If it is determined at step S17 that the definedtime period T2 has not elapsed, then the personal computer 100 decidesat step S18 whether or not the finger 11 is touching any of theoperation regions 3A to 3R (step S18). If it is determined that thefinger 11 is not touching any of the operation regions 3A to 3R, thenthe personal computer 100 returns the processing to step S17.

On the other hand, if it is determined at step S17 that the defined timeperiod T2 has elapsed after the time at which the finger 11 is movedaway from the operation region (disappearance of the touch), then thepersonal computer 100 returns the processing to step S16, at which itinstructs the image information production circuit 110 to stopproduction of the image IDX of the operational element dispositioninformation so as to stop sending the image IDX of the operationalelement disposition information to the display apparatus 101. Then, thepersonal computer 100 returns the processing to step S1 to repeat theprocesses of the steps beginning with step S1.

On the other hand, if the personal computer 100 determines at step S18that the finger 11 is touching one of the operation regions 3A to 3R,then it returns the processing to step S7.

It is to be noted that the function executed at steps S6 and S14 is afunction relating to inputting of handwritten information by a pointerto the handwritten information inputting region 2 as described above.For example, if, at step S12, a push switch immediately below theoperation region 3F, to which a function “ctrl” is assigned, isdepressed by the finger 11, the corresponding function is executed atstep S14, as shown in FIG. 8A, which involves, for example, enlargingthe image Px displayed on the display screen 101D.

As another example, if a push switch immediately below the touch wheeloperation region 3Rb of the operation region 3R (FIG. 1), to which afunction “Rotation” is assigned, is depressed at step S12, the rotatingfunction is executed at step S14, which involves rotating the image Pxdisplayed on the display screen 101D, as shown in FIG. 8B.

The touch wheel operation region 3Rb of the operation region 3R may beused also as an operational element to change user selections, when apush switch below another operation region has been depressed and aprocessing function assigned to that depressed operation region is inoperation. For example, when a function or process is initiated by apressing operation on one of the operation regions 3A-3H, by operatingthe touch wheel operation region 3Rb, the user can change or designatethe color, line width, rotational amount, movement amount, expansionsize and reduction size of the handwritten information displayed on thedisplay screen 101D.

Further, in the touch wheel operation region 3Rb of the operation region3R, a plurality of push switches corresponding to the mark positionsindicated by the triangles in FIG. 1 are provided as described above.Thus, when a rotation instruction is to be issued to the drawing inputimage Px in the handwritten information inputting region 2, if theposition of the upwardly or downwardly directed triangle is depressed,for example, then the image Px can be rotated around a horizontal axisthat is a first rotational axis. Meanwhile, if the position of theleftwardly or rightwardly directed triangle mark is depressed, then theimage Px can be rotated around a vertical axis, which is a secondrotational axis different from the first rotational axis.

Effects of the First Embodiment

As described above, with the tablet device 1, provided as the electronicapparatus of the first embodiment, when a touching operation thatcontinues for more than the defined time period T1 to reflect the user'sintentional act is detected on any of a plurality of operation regions3A to 3R provided in the operation switch section 3, an image IDX of theoperational element disposition information indicative of the pluralityof operation regions 3A to 3R provided in the operation switch section 3is displayed on the display screen 101D of the external displayapparatus 101, as shown in FIGS. 7A and 7B. Further, in the image IDX ofthe operational element disposition information, the operation regiontouched by the user is displayed in a manner distinguishable from otheroperation regions, to thereby indicate which of the operation regions iscurrently selected, as also shown in FIGS. 7A and 7B.

Accordingly, due to the image IDX of the operational element dispositioninformation being displayed on the display screen 101D, it is notnecessary for the user to move his line of sight to the operation switchsection 3 in order to operate the operation switch section 3 of thetablet device 1, and consequently, the user can carry out informationinputting with a high degree of operability and efficiency.Specifically, the user can input handwritten information using, forexample, the electronic pen 10 in the handwritten information inputtingregion 2, to thereby create a line drawing or the like, while tactuallyconfirming a desired operation region provided on the operation switchsection 3 with the finger 11 without having to move his line of sightfrom the display screen 101D, on which an image Px of the line drawingis displayed. Further, when a processing function assigned to theselected operation region is executed, the user can visually confirm, onthe display screen, contents (substance) of the desired processingfunction being carried out on the handwritten information that has beeninputted or is to be inputted. Still further, in the present embodiment,since the image IDX of the operational element disposition informationincludes text characters that describe the processing functions assignedto various operation regions, the user can carry out each operationwhile visually confirming a desired processing function to be performedon the display screen 101D.

Accordingly, while drawing the image Px with a pointer in thehandwritten information inputting region 2, the user can apply a desiredprocessing function to the image Px without having to move his line ofsight from the display screen 101D. For example, the user can operatethe operation regions 3A to 3H and 3R of the operation switch section 3with a finger 11 of the left hand (or the right hand) without having tomove his line of sight from the display screen 101D, while performinginputting operation of handwritten information, such as the image Px, inthe handwritten information inputting region 2 using the electronic pen10 held by the right hand (or the left hand).

Since text characters indicative of the functions assigned to theindividual operation regions are displayed on the image IDX of theoperational element disposition information, even if the user isunfamiliar with operation of the tablet device 1, the user can readilyconfirm the functions assigned to the individual operation regions.

Further, in the present embodiment, when one of the operation regionsprovided on the operation switch section 3 of the tablet device 1 isonly briefly touched for a period of time shorter than the defined timeperiod T1, an image IDX of the operational element dispositioninformation is not displayed on the display screen 101D. Thus, when theoperator does not intend to display the image IDX of the operationalelement disposition information, an image of the operational elementdisposition information is not displayed even if an operation region isinadvertently or erroneously touched for a short period of time.Therefore, unnecessary display of the image IDX can be avoided.

Still further, when the aspect ratio of the display screen 101D of thedisplay apparatus 101 is a second aspect ratio of 16:9 different from afirst (primary) aspect ratio of 4:3, the image IDX of the operationalelement disposition information is displayed in the display region thatdoes not overlap with the image Px input by hand writing. Therefore, theuser can carry out inputting operation of an image Px by hand writingfree of any obstruction by the image IDX of the operational elementdisposition information.

Further, once the image IDX of the operational element dispositioninformation is displayed on the display screen, then even if a touch onan operation region disappears (e.g., the finger is removed), the imageIDX of the operational element disposition information continues to bedisplayed for the defined time period T2 after the touch disappearance,for improved operability and ease of use by the user.

Modification to the First Embodiment

While, in the first embodiment described above, the image informationproduction circuit 110 is illustrated as embodied in a software programinstalled in the personal computer 100, it can also be embodied in ahardware structure. Further, it is possible to have the tablet device 1execute the function of the image information production circuit 110 asa hardware process or a software process based on a program.

In the first embodiment described above, a touch on any of the operationregions 3A to 3H and 3R is detected by the capacitive method, but thehandwritten information inputting device may be configured otherwisesuch that it can detect a touch by the electromagnetic induction methodor by the resistance film method.

Second Embodiment

In the first embodiment described above, the handwritten informationinputting device is a tablet device that does not have a display screen.However, the present invention can be applied also to an electronicapparatus that includes both a display screen and a function of ahandwritten information inputting device, such as a portable electronicapparatus. For example, while a portable information terminal has adisplay screen of, for example, an LCD (Liquid Crystal Display) or anorganic EL (Electro Luminescence) display, since the display screen issmall, sometimes it is difficult to view the displayed contents or tocarry out operation on the display screen. The present inventionprovides means suitable for performing a handwritten information inputrelated function on such a portable information terminal.

A second embodiment of the invention described below relates to aportable electronic apparatus, which has a display screen of a smallsize and yet is configured to address the problem described above.

FIG. 9 shows a portable telephone terminal 200, which is an example of aportable electronic apparatus according to the second embodiment, and adisplay apparatus 300, which is an external display apparatus connectedby wireless connection to the portable telephone terminal 200. Theportable telephone terminal 200 in this example is a high-performancecommunication terminal called a smart phone. FIG. 10 is a block diagramshowing an example of a hardware configuration of the portable telephoneterminal 200. It is to be noted that the portable telephone terminal 200as an example of the electronic apparatus of the second embodimentincludes a built-in function as an information processing device and ahandwritten information inputting device, as well as a built-in functionto connect with an external display apparatus.

The portable telephone terminal 200 includes a control circuit 210formed, for example, of a microcomputer, a memory 202, a communicationcircuit 203, a display interface 204, a touch panel interface 205A, asensor panel interface 205B, a display image production circuit 206,wireless connection circuits 207A and 207B and a wireless connectionconfirmation circuit 208, which are all connected to a system bus 201.

The memory 202 stores a program for performing telephone communicationfor the portable telephone terminal 200, and a program for detecting apointing input based on a touch panel 212A that detects a pointingoperation by a finger 221 and a pointing input based on a sensor panel212B that detects a pointing operation by an electronic pen 220 (e.g.,the touch panel 212A of the capacitive type and the sensor panel 212B ofthe electromagnetic induction type for detecting a pointing operation bythe finger 221 and the electronic pen 220, respectively). The memory 202further includes a program for carrying out wireless connection andwireless communication to and with an external display apparatus via thewireless connection circuits 207A and 207B. The memory 202 also includesother application programs and storage regions for storing various data.

The control circuit 210 uses a defined program from among the programsstored in the memory 202 to carry out software processing to executefunctions of an information processing device. The function of thehandwritten information inputting device is carried out based onsoftware processing of the control circuit 210, the touch panelinterface 205A, the sensor panel interface 205B, the touch panel 212Aand the sensor panel 212B. Further, the function of a connection circuitis carried out based on software processing of the control circuit 210,the wireless connection circuits 207A and 207B and the wirelessconnection confirmation circuit 208.

The communication circuit 203 having an antenna is a circuit configuredto carry out portable telephone communication. A display 211 formed, forexample, of an LCD, is connected to the display interface 204. A touchpanel 212A, for example, of the capacitive type, is connected to thetouch panel interface 205A. Further, a sensor panel 212B, for example,of the electromagnetic induction type, is connected to the sensor panelinterface 205B. The touch panel 212A of the capacitive type and thesensor panel 212B of the electromagnetic induction type are disposed ina superposed relationship on the display 211.

As shown in FIG. 9, the touch panel 212A of the capacitive type havingtransparency (not specifically shown) is disposed in a superposedrelationship on (over) a display screen 211D, so that a pointingoperation by the finger 221 as a pointer can be detected at any locationon the display screen 211D of the display 211, which may be a monitorapparatus, a projector apparatus or a TV receiver apparatus, forexample. In this example, the sensor panel 212B of the electromagneticinduction type (not specifically shown) is also disposed in a superposedrelationship on (beneath) the display screen 211D so that a pointingoperation by the electronic pen 220 can be detected at any location onthe display screen 211D. Although the sensor panel 212B of theelectromagnetic induction type is typically disposed on the opposite(rear) side of the display screen 211D, when the sensor panel 212B isformed of transparent electrodes of an ITO film or the like, it ispossible to dispose the sensor panel 212B of the electromagneticinduction type in a superposed relationship between the (transparent)touch panel 212A and the display screen 211D.

In the present example, the sensor panel 212B of the electromagneticinduction type is disposed on the rear face side (lower side) of thedisplay screen 211D of the display 211, while the touch panel 212A ofthe capacitive type is disposed on the display screen 211D side (upperside) of the display 211. It is to be noted that the touch panel 212A ofthe capacitive type is typically formed by arranging transparentelectrodes of an ITO film or the like on a transparent substrate, aswell known in the art.

The display image production circuit 206 produces image information tobe displayed on the display 211. The wireless connection circuits 207Aand 207B produce radio signals to allow the image information, producedby the display image production circuit 206, to be displayed on thedisplay apparatus 300, which is an external display apparatus. It shouldbe noted that the display image production circuit 206 may beimplemented as a software processing functional section executed by thecontrol circuit 210 based on a program stored in the memory 202.

The wireless connection circuit 207A is a wireless communicationfunction section in compliance with, for example, the Bluetoothstandards, for which an antenna is provided in the housing of theportable telephone terminal. The wireless connection circuit 207B is awireless communication function section in compliance with, for example,the WiFi (registered trademark) standards, also for which an antenna isprovided in the housing. While two wireless connection circuits areprovided in the present example, three or more wireless connectioncircuits may be provided.

Which one of the wireless connection circuit 207A and the wirelessconnection circuit 207B is used depends on which transmission standardsare adopted by the wireless connection circuit of the external displayapparatus 300.

The wireless connection confirmation circuit 208 is a circuit, whichperforms a search using the wireless connection circuit 207A and thewireless connection circuit 207B, to determine which transmissionstandards are adopted by the wireless connection circuit provided in theexternal display apparatus 300. When the user of the portable telephoneterminal 200 desires to perform image transmission to the externaldisplay apparatus 300, the user first performs a defined operation onthe touch panel 212A or the sensor panel 212B, to activate the wirelessconnection confirmation circuit 208 to register a “pairing” regardingwireless communication with the external display apparatus 300. Thisfunction of the wireless connection confirmation circuit 208 may beimplemented as a software processing function executed by the controlcircuit 210 based on a program stored in the memory 202.

FIG. 11 is a flow chart illustrating an example of operation performedby the wireless connection confirmation circuit 208 to register pairingregarding wireless communication.

The control circuit 210 searches for a display apparatus, to which awireless connection can be established by the wireless connectioncircuit 207A or 207B to send image information (step S21), anddetermines whether or not such a display apparatus exists as an externaldisplay apparatus (step S22). If it is determined at step S22 that anappropriate display apparatus does not exist, then the control circuit210 displays on the display screen 211D that no appropriate displayapparatus is available (step S23) and ends the processing routine.

On the other hand, if it is determined at step S22 that an appropriatedisplay apparatus exists, then the control circuit 210 displays a tableof such display apparatuses on the display screen 211D (step S24). Inthis instance, if only one appropriate display apparatus exists, onlythe one display apparatus is displayed in the table.

Then, the control circuit 210 accepts the user's selection of a displayapparatus from within the table (step S25), and registers a wirelessconnection circuit for achieving a wireless connection with the selecteddisplay apparatus (step S26). Then, the processing routine ends. Whenonly one appropriate display apparatus exists, the process at step S25involves confirming acceptance of the one appropriate display apparatus.

The portable telephone terminal 200 of the present example includes, asone of the application programs stored in the memory 202, a handwritteninformation inputting application. The handwritten information inputtingapplication allows inputting of handwritten information onto the displayscreen 211D using a pointer such as an electronic pen 220, whichincludes a resonance circuit in a housing, a finger 221, or the like, asshown in FIG. 9.

In the handwritten information inputting application, the display screen211D of the display 211 includes a relatively narrow region on theleft-hand side of a broken line 230 as a function disposition region231, and a relatively wide region on the right-hand side of the brokenline 230 as a handwritten information inputting region 232, as shown inFIG. 9. Further, in the handwritten information inputting application,in the function disposition region 231, icons 233A, 233B and 233C, towhich various processing functions regarding handwritten inputinformation are assigned, are displayed in an array on the displayscreen 211D. In this instance, the assigned processing functionsregarding handwritten input information include, for example, changing adisplay color of the handwritten inputted image information, changingthe line thickness of, rotating, moving, expanding (enlarging),reducing, or selecting the line type of the handwritten inputted imageinformation, and so forth.

In the example of FIG. 9, three processing functions are assigned to thethree icons 233A, 233B and 233C, but of course the number of iconscorresponding to the number of processing functions to be assignedthereto can be freely determined according to each application.

The icons 233A, 233B and 233C form operational elements, each as anobject to be operated by the user. As hereinafter described, if any ofthe icons 233A, 233B and 233C is operated on the touch panel 212A of thecapacitive type by a pointer such as the finger 221 or the electronicpen 220, then the control circuit 210 detects the operation of the icon233A, 233B or 233C and executes a process in accordance with a result ofthe detection. In the present example, for each of the icons 233A, 233Band 233C, a first gesture and a second gesture are defined as operationmodes to be applied to each icon.

The first gesture is a gesture operation wherein a touch state on any ofthe icons 233A, 233B and 233C continues for a defined period of time. Ifthe control circuit 210 detects this first gesture, then it producesimage information, which includes operational element dispositioninformation including a disposition image of the icons 233A, 233B and233C disposed in the function disposition region 231 and a handwritteninput image drawn in the handwritten information inputting region 232,and supplies the produced image information to the external displayapparatus 300. An image IDXa of the operational element dispositioninformation and a handwritten input image Pxa are displayed, as shown inFIG. 9, on a display screen 300D of the external display apparatus 300.In short, in the present example, the control circuit 210 suppliesinformation on an image displayed on the display screen 211D of thedisplay 211 to the external display apparatus 100 so that the image isdisplayed on the display screen 300D of the display apparatus 300.

It is to be noted that only those operational elements to whichfunctions related to processing of handwritten information are assigned,such as the icons 233A, 233B and 233C disposed in the functiondisposition region 231, are configured such that when it is touchedcontinuously for more than the defined time period T1, the operationalelement disposition information is supplied to the external displayapparatus 300. On the other hand, other operational buttons provided onthe housing of the portable telephone terminal 200, such as a homebutton formed of a push button or the like, are not configured as anoperational element that causes display of the operational elementdisposition information.

Meanwhile, the second gesture is a gesture, different from the firstgesture, on the icons 233A, 233B and 233C as operational elements, suchas a double-tapping operation, for example. To the icons 233A, 233B and233C disposed on the function disposition region 231, differentprocessing functions related to handwritten input information areassigned. If the control circuit 210 detects this second gesture, thenit starts up the actual processing function corresponding to one of theicons 233A, 233B and 233C disposed on the function disposition region231, from which the second gesture is detected.

It is to be noted that a double tapping operation as the second gesturefor starting up a processing function is merely one example, and anyother gesture operation can be used as the second gesture as long as thegesture operation is distinguishable from the first gesture to signifystarting up of the corresponding function.

The touch panel 212A of the capacitive type and the sensor panel 212B ofthe electromagnetic induction type detect a position pointed to by apointer such as the electronic pen 220 or the finger 221 on the displayscreen 211D, and supply the detected pointed position information to thecontrol circuit 210. The control circuit 210 recognizes, from thereceived pointed position information, whether the pointed positioninformation is a pointing input to the function disposition region 231or a pointing input to the handwritten information inputting region 232,and executes a process corresponding to the recognized operation regionusing a program stored in the memory 202. Further, the control circuit210 evaluates a time situation of the pointing input by the pointer,such as the electronic pen 220 or the finger 221, to determine whetherthe pointing input is the first gesture or the second gesture.

In this instance, the sensor panel 212B is configured of theelectromagnetic induction type, as shown in FIG. 12 for example. Theelectronic pen 220, which is used as a pointer for the sensor panel 212Bof the electromagnetic induction type, includes a built-in resonancecircuit configured from a coil 220L and a capacitor 220C connected inparallel to the coil 220L, as shown in FIG. 12.

In the sensor panel 212B, an X-axis direction loop coil group 241X and aY-axis direction loop coil group 241Y are disposed on different faces ofa wiring substrate (not specifically shown) and disposed in a superposedrelationship on each other. In this example, each of the loop coilgroups 241X and 241Y is configured from a plurality of rectangular loopcoils, and n loop coils are disposed in the X-axis direction while mloop coils are disposed in the Y-axis direction. Further, the loop coilgroups 241X and 241Y are disposed not only in the handwritteninformation inputting region 232 but also in the function dispositionregion 231 so that the overall display screen 211D including thefunction disposition region 231 is covered as a detection region.

Further, a sensor circuit section is provided on the sensor panel 212B.The sensor circuit section includes a selection circuit 251, anoscillator 252, a current driver 253, a transmission/reception switchingcircuit 254, a reception amplifier 255, a detection circuit 256, alow-pass filter 257, a sample hold circuit 258, an A/D (Analog toDigital) conversion circuit 259 and a process controlling circuit 250.

The X-axis direction loop coil group 241X and the Y-axis direction loopcoil group 241Y are connected to the selection circuit 251. Theselection circuit 251 successively selects one loop coil of the two loopcoil groups 241X and 241Y in accordance with a controlling instructionfrom the process controlling circuit 250.

The oscillator 252 generates an ac signal of a frequency f0. The acsignal is supplied to and converted into current by the current driver253, whereafter it is sent to the transmission/reception switchingcircuit 254. The transmission/reception switching circuit 254 switchesbetween the connection destination (between the transmission sideterminal T and the reception side terminal R), to which the loop coilselected by the selection circuit 251 is to be connected, after everydefined period of time under the control of the process controllingcircuit 250. The current driver 253 is connected to the transmissionside terminal T, and the reception amplifier 255 is connected to thereception side terminal R.

Accordingly, during transmission time, the ac signal from the currentdriver 253 is supplied to the loop coil selected by the selectioncircuit 251 through the transmission side terminal T of thetransmission/reception switching circuit 254. On the other hand, duringreception time, an induced voltage generated in the loop coil selectedby the selection circuit 251 is supplied to the reception amplifier 255through the selection circuit 251 and the reception side terminal R ofthe transmission/reception switching circuit 254 and amplified by thereception amplifier 255, whereafter it is sent to the detection circuit256.

A signal detected by the detection circuit 256 is supplied, through thelow-pass filter 257 and the sample hold circuit 258, to the A/Dconversion circuit 259. The A/D conversion circuit 259 converts theanalog signal into a digital signal and supplies the digital signal tothe process controlling circuit 250.

The process controlling circuit 250 carries out control for positiondetection. In particular, the process controlling circuit 250 controlsselection of a loop coil by the selection circuit 251, signal switchingin the transmission/reception switching circuit 254, the timing of thesample hold circuit 258, and so forth.

The process controlling circuit 250 changes over thetransmission/reception switching circuit 254 so as to be connected tothe transmission side terminal T, to carry out energization control of aloop coil selected from within the X-axis direction loop coil group 241Xor the Y-axis direction loop coil group 241Y by the selection circuit251, and to have the selected loop coil transmit an electromagneticwave. The resonance circuit in the electronic pen 220 as a pointerreceives the electromagnetic wave transmitted from the loop coil andaccumulates energy.

Thereafter, the process controlling circuit 250 changes over thetransmission/reception switching circuit 254 so as to be connected tothe reception side terminal R. Consequently, in the loop coils of theX-axis direction loop coil group 241X and the Y-axis direction loop coilgroup 241Y, an induced voltage is generated by an electromagnetic wavetransmitted from the electronic pen 220. The process controlling circuit250 calculates a coordinate value of the pointed position in the X-axisdirection and the Y-axis direction on the display screen 211D based onthe level of the voltage values of the induced voltages generated in theloop coils. Then, the process controlling circuit 250 suppliesinformation of the calculated coordinate value to the control circuit210 through the sensor panel interface 205B and the system bus 201.

The touch panel 212A of the capacitive type may have, for example, theconfiguration of the sensor disclosed in the patent document (JapanesePatent Laid-Open No. 2011-3035) similarly to that in the handwritteninformation inputting region 2 of the first embodiment. In theillustrated example, the touch panel 212A is configured such that aplurality of electrodes in the X-axis direction and a plurality ofelectrodes in the Y-axis direction are provided over the entire area ofthe display screen 211D similarly to the sensor panel 212B of theelectromagnetic induction type. The control circuit 210 recognizes,based on the position coordinate output of the touch panel 212A, whetherthe position coordinate output is a pointing input to the functiondisposition region 231 or a pointing input to the handwritteninformation inputting region 232, and executes a process correspondingto the recognized region using a program stored in the memory 202.

Accordingly, in the portable telephone terminal 200 as an example of theelectronic apparatus of the second embodiment, inputting of handwritteninformation to the handwritten information inputting region 232 can becarried out using the electronic pen 220 or using the finger 221.Similarly, detection of an operational element in the functiondisposition region 231 as well as activation of processes assigned tothe operational elements of the function disposition region 231 can becarried out using the electronic pen 220 or using the finger 221.According to this configuration, since operations of the electronic pen220 and the finger 221 can be detected not only in the handwritteninformation inputting region 232 but also in the function dispositionregion 231, it is possible to carry out inputting of handwritteninformation to the handwritten information inputting region 232 usingeither the electronic pen 220 or the finger 221 while operating theoperational elements in the function disposition region 231. Further,since the electronic pen 220 and the finger 221 can be operatedsimultaneously, it is possible to use multiple pointers to carry outinputting of handwritten information to the handwritten informationinputting region 232 and to use multiple pointers to operate theoperational elements in the function disposition region 231.

Now, a sample operation of the handwritten inputting applicationdescribed above, to be performed by the control circuit 210, isdescribed with reference to flow charts of FIGS. 13 to 15.

The control circuit 210 monitors coordinate outputs from the touch panel212A and the sensor panel 212B, to determine whether a touch on thedisplay screen 211D by a pointer such as a finger 221 or an electronicpen 220 is detected (step S101). If a touch is not detected, then thecontrol circuit 210 returns the processing to step S101 to continuemonitoring for a touch.

If it is determined at step S101 that a touch by a pointer is detected,then the control circuit 210 determines whether or not any of the icons233A, 233B and 233C as operational elements provided in the functiondisposition region has been touched (step S102). If it is determined atstep S102 that none of the icons 233A, 233B and 233C in the functiondisposition region 231 is touched, then the control circuit 210 carriesout a process in response to the detected touch operation (step S103).At step S103, the control circuit 210 accepts, for example, an input ofhandwritten information to the handwritten information inputting region232 and produces image information of the received information, and thencarries out a process for displaying a handwritten inputting image onthe display screen 211D of the display 211 or a like process inaccordance with the produced image information.

If it is determined at step S102 that one of the icons 233A, 233B and233C of the function disposition region 231 is touched, then the controlcircuit 210 starts up the wireless connection confirmation circuit 208to decide whether or not there exists an external display apparatus towhich wireless connection can be established (step S104).

If it is decided at step S104 that no external display apparatus exists,then the control circuit 210 executes a process relating to a processingfunction assigned to the touched icon, which is other than a processrelating to transmission of the image information to the externaldisplay apparatus (step S105).

On the other hand, if it is decided at step S104 that there exists anexternal display apparatus to which wireless connection can beestablished, then the control circuit 210 decides whether or not thereexists a wireless connection circuit that can be paired with theexternal display apparatus, to which wireless connection can beestablished (step S106). If it is decided at step S106 that there existno wireless connection circuit with which pairing is possible, then thecontrol circuit 210 executes a process relating to a processing functionassigned to the touched icon other than the process relating totransmission of the image information to the external display apparatus(step S107).

On the other hand, if it is decided at step S106 that there exists awireless connection circuit with which pairing is possible, then thecontrol circuit 210 determines whether or not a defined time period T1has elapsed since the touch on an icon was detected at step S102 (stepS111 of FIG. 14). In other words, at step S111, the control circuit 210determines whether or not a first gesture operation is carried out.

If it is determined at step S111 that the defined time period T1 has notelapsed, then the control circuit 210 determines whether or not thetouch on an icon detected at step S102 is continuing (step S112). If itis determined at step S112 that the touch on an icon detected at stepS102 is not continuing, that is, the touch has been cancelled (removed),then the control circuit 210 returns the processing to step S101.

On the other hand, if it is determined at step S112 that the touch on anicon as an operational element detected at step S102 is continuing, thenthe control circuit 210 determines whether or not a double tappingoperation, that is, a second gesture operation, is carried out on theicon (step S113). If it is decided at step S113 that a double tappingoperation is carried out on the icon as an operational element, then thecontrol circuit 210 starts up and executes a processing functionassigned to the icon (step S114). At step S114, the control circuit 210carries out a processing function assigned to the icon and related tohandwritten information, for example, change of a display color, changeof the thickness or the type of a drawing line, rotation, movement,expansion and reduction of a drawn image.

On the other hand, if it is decided at step S111 that the defined timeperiod T1 has elapsed, that is, if the first gesture operation isdetected, then the control circuit 210 supplies image information to theexternal display apparatus 300 through the wireless connection circuit207A or 207B, for which pairing has been registered (step S115). Thesupplied image information includes an image IDXa of the operationalelement disposition information formed of images of the icons 233A, 233Band 233C disposed in the function disposition region 231 and ahandwritten image Pxa drawn in the handwritten information inputtingregion 232. At this time, in the operational element dispositioninformation including the images of the icons 233A, 233B and 233Cdisposed in the function disposition region 231, the touched icon isrendered distinguishable from other icons. For example, the touched iconis indicated with a thick frame, displayed in a different color, and soforth, such that it is visually recognizable that the touched icon(operational element) is currently selected. Further, in the secondembodiment, unlike in the first embodiment, once supply of the imageinformation to the external display apparatus 300 is started, thecontrol circuit 210 continues to supply the image information to theexternal display apparatus 300 even after a defined time period haslapsed until and unless an explicit instruction to discontinue thesupply of the image information is received from the user, ashereinafter described.

Though not shown, in the second embodiment also, the portable telephoneterminal 200 recognizes the aspect ratio of the display screen 300D ofthe wirelessly connected external display apparatus 300 in advance. Whenthe aspect ratio is 4:3, the image IDXa of the operational elementdisposition information is displayed in the form in which it issuperposed on the handwritten input image Pxa, as shown in FIG. 9. Onthe other hand, when the aspect ratio is 16:9, as shown in FIG. 7B, theimage IDXa of the operational element disposition information isdisplayed in a black frame region other than the display region for thehandwritten input image Pxa so that the images IDXa and Pxa do notoverlap with each other.

Returning to FIG. 14, the control circuit 210 then decides whether ornot a different icon in the function disposition region 231 is touched(step S116). If it is decided at step S116 that a different icon in thefunction disposition region 231 is touched, then the control circuit 210produces image information that indicates that the different icon istouched and selected. The control circuit 210 sends the produced imageinformation to the external display apparatus 300, through the pairedwiring connection circuit, for display on the display screen 211D (stepS117). Thereafter, the control circuit 210 returns the processing tostep S116 and repeats the processes beginning with step S116.

If it is decided at step S116 that a different icon in the functiondisposition region 231 is not touched, then the control circuit 210decides whether or not a double tapping operation (i.e., the secondgesture operation in this example) is carried out on the icon that iscurrently touched (step S118). If it is decided that a double tappingoperation is not carried out, then the control circuit 210 returns theprocessing to step S116.

If it is decided at step S118 that a double tapping operation is carriedout on the icon that is currently touched, then the control circuit 210starts up a processing function assigned to the icon (step S119).

Then, the control circuit 210 decides whether or not an operation input(i.e., an input via an operational element) to the display screen 211Dhas been received (step S121 of FIG. 15). If it is decided that anoperation input is not received, then the control circuit 210 returnsthe processing to step S116 and repeats the processes beginning withstep S116.

If it is decided at step S121 that an operation input is received, thenthe control circuit 210 decides whether or not the operation input is aninstruction to stop supply of an image to the external display apparatus300 (step S122). If it is decided at step S122 that the operation inputis not the instruction to stop supply of an image to the externaldisplay apparatus 300, then the control circuit 210 executes a processcorresponding to the received operation input on the handwritten(hand-drawn) information displayed on the handwritten informationinputting region 232. The control circuit 210 then produces imageinformation and sends the image information to the external displayapparatus 300, through the wireless connection circuit, in order todisplay the image information on the display screen 211D (step S123).

On the other hand, if it is decided at step S122 that the operationinput is an instruction to stop supply of an image to the externaldisplay apparatus 300, then the control circuit 210 stops sending of theimage information to the external display apparatus 300 (step S124).

With the electronic apparatus of the second embodiment described above,handwritten information inputting to a display screen of a portabletelephone terminal can be carried out using a larger display screen ofan external display apparatus. In this case, operational elementdisposition information comprised of a plurality of icons, which isdisplayed on the display screen of the portable telephone terminal, isalso displayed on the external display apparatus so that a user canselect the icons similarly as if the user is performing a routine iconselection operation on the display screen of the display apparatus. Thatis, the user can carry out handwritten inputting operation withouthaving to move his eyes off the display screen of the external displayapparatus.

Other Embodiments and Modifications

In the embodiments described above, an image of the operational elementdisposition information is displayed on the external display apparatuswhen any of the operational elements included in the functiondisposition region is touched continuously for more than the definedtime period T1. However, the operational element disposition informationmay be displayed on the external display apparatus only when a specificoperational element, determined in advance from among the plurality ofoperational elements included in the function disposition region, istouched continuously for more than the defined time period T1.

In the first embodiment described above, the tablet device 1 as ahandwritten information inputting device is connected to the personalcomputer 100, and the personal computer 100 is configured to carry outinformation processing such as to produce image information to bedisplayed on the external display apparatus based on pointer positioninformation and operation input information received from the tablet 1,and to establish connection with the external display apparatus,wirelessly or via wire, to transmit the produced image informationthereto. However, the present invention is not limited to such aconfiguration and includes other configurations, such as a notebook-typepersonal computer with a display apparatus function, to which a tabletdevice is connected wirelessly or by wire.

Further, when the external display apparatus includes a function as aninformation processing device, as in a personal computer, it is possibleto adopt a configuration in which a tablet device is connected to theexternal display apparatus wirelessly or by wire.

As described hereinabove, the function as an information processingdevice involves carrying out information processing based on pointerposition information and operation input information received from thetablet device 1. The function is typically carried out by a CPU, memory,and software that operates the CPU. Accordingly, by incorporating aninformation processing device into a tablet device, it is possible toadopt a configuration in which a tablet that incorporates an informationprocessing device is connected to an external display apparatus,wirelessly or by wire.

While the electronic apparatus of the second embodiment is describedabove as a portable telephone terminal, the electronic apparatusaccording to the present invention is not limited to this particularconfiguration, and may be embodied in any portable electronic apparatusas long as it is connectable to an external display apparatus wirelesslyor by wire and it includes a handwritten information inputting function.

The various embodiments described above can be combined to providefurther embodiments. All of the U.S. patents, U.S. patent applicationpublications, U.S. patent applications, foreign patents, foreign patentapplications and non-patent publications referred to in thisspecification are incorporated herein by reference, in their entirety.Aspects of the embodiments can be modified, if necessary to employconcepts of the various patents, applications and publications toprovide yet further embodiments.

These and other changes can be made to the embodiments in light of theabove-detailed description. In general, in the following claims, theterms used should not be construed to limit the claims to the specificembodiments disclosed in the specification and the claims, but should beconstrued to include all possible embodiments along with the full scopeof equivalents to which such claims are entitled. Accordingly, theclaims are not limited by the disclosure.

What is claimed is:
 1. A handwritten information inputting device, foruse with an information processing device and a display apparatus, thehandwritten information inputting device comprising: a handwritteninformation inputting region, into which handwritten informationcorresponding to an operation of a pointer is to be inputted; and afunction disposition region, in which a plurality of operationalelements are disposed, wherein each operational element is assigned aprocess related to handwritten information inputted by an operation ofthe pointer in the handwritten information inputting region, and theoperational element includes a touch sensor and a pressure sensor, thepressure sensor including a switch that is activated by an appliedpressure; wherein the handwritten information inputting device and theinformation processing device cooperate with each other such that, inresponse to a continuous touch on one of the operational elements for adefined period of time detected by the touch sensor, operational elementdisposition information regarding the operational elements disposed inthe function disposition region is displayed on the display apparatus,and in response to a pressure applied on the one of the operationalelements detected by the pressure sensor, the process assigned to theone of the operational elements is started.
 2. The handwritteninformation inputting device according to claim 1, wherein, when thepressure applied on the one of the operational elements is detectedwithin the defined period of time, the operational element dispositioninformation regarding the operational elements disposed in the functiondisposition region is not displayed on the display apparatus.
 3. Thehandwritten information inputting device according to claim 1, whereinthe process assigned to the one of the operational elements is selectedfrom a group consisting of change of a display color, change of adrawing line width, rotation, movement, enlargement, and reductionrelated to the handwritten information displayed on the displayapparatus.
 4. The handwritten information inputting device according toclaim 3, wherein the function disposition region includes a touch wheeloperational element for designating a rotation amount such that, byoperating the touch wheel operational element in response to a processstarted by the pressure sensor of the one of the operational elements,an amount of change of display color, an amount of change of a drawingline width, a rotation amount, a movement amount, an enlargement size,or a reduction size can be designated regarding the handwritteninformation displayed on the display apparatus.
 5. The handwritteninformation inputting device according to claim 1, wherein theoperational elements are configured to allow detection of both a firsttouching gesture and a second touching gesture different from the firsttouching gesture, and the operational element disposition informationregarding the operational elements disposed in the function dispositionregion is displayed on the display apparatus in response to a continuousapplication of the first touching gesture on the one of the operationalelements for the defined period of time.
 6. The handwritten informationinputting device according to claim 5, wherein the continuousapplication of the first touching gesture on an operational element forthe defined period of time means that the operational element remains incontact with the pointer for the defined period of time.
 7. Thehandwritten information inputting device according to claim 5, whereinthe second touching gesture is a double-tapping gesture comprised ofsuccessively touching an operational element twice.
 8. The handwritteninformation inputting device according to claim 5, wherein the processassigned to the one of the operational elements is selected from a groupconsisting of change of a display color, change of a drawing line width,rotation, movement, enlargement, and reduction related to thehandwritten information displayed on the display apparatus, and whereinthe process is started by the second touching gesture.
 9. Thehandwritten information inputting device according to claim 1, whereinthe touch sensor of the operational element is a capacitive type sensor.10. The handwritten information inputting device according to claim 1,wherein a capacitive type sensor is disposed in the handwritteninformation inputting region to detect inputting of the handwritteninformation thereon with the pointer.
 11. The handwritten informationinputting device according to claim 1, wherein the pointer includes aresonance circuit and the handwritten information inputting regionincludes a loop coil disposed therein, such that inputting of thehandwritten information corresponding to an operation of the pointercarried out in the handwritten information inputting region is detectedbased on an electromagnetic coupling between the resonance circuit inthe pointer and the loop coil.
 12. The handwritten information inputtingdevice according to claim 11, wherein the loop coil is disposed so as todetect an operation of the pointer on the operational elements disposedin the function disposition region.
 13. The handwritten informationinputting device according to claim 1, wherein the operational elementdisposition information regarding the operational elements is displayedon the display apparatus adjacent to a region in which the inputtedhandwritten information is displayed.
 14. The handwritten informationinputting device according to claim 1, wherein the operational elementdisposition information regarding the operational elements is displayedon the display apparatus in a superposed relationship with a region inwhich the inputted handwritten information is displayed.
 15. Thehandwritten information inputting device according to claim 1, wherein,to each of the operational elements disposed in the function dispositionregion, a plurality of functions are assigned including a first functionof displaying the operational element disposition information regardingthe operational elements on the display apparatus, which is common toall of the operational elements, and a second function that is uniquelyassigned to the operational element.
 16. The handwritten informationinputting device according to claim 1, wherein, to each of theoperational elements, a plurality of processes related to thehandwritten information inputted in the handwritten informationinputting region are selectably assigned.
 17. The handwritteninformation inputting device according to claim 1, which integrallyincorporates the information processing device.
 18. A portableelectronic apparatus for use with an external display apparatus,comprising: a handwritten information inputting device; and aninformation processing device; wherein the handwritten informationinputting device includes a handwritten information inputting region,into which handwritten information corresponding to an operation of apointer is to be inputted, and a function disposition region, in which aplurality of operational elements are disposed, wherein each operationalelement is assigned a process related to handwritten informationinputted by an operation of the pointer in the handwritten informationinputting region, and the operational element includes a touch sensorand a pressure sensor, the pressure sensor including a switch that isactivated by an applied pressure; and wherein the handwritteninformation inputting device and the information processing devicecooperate with each other such that, in response to a continuous touchon one of the operational elements for a defined period of time detectedby the touch sensor, operational element disposition informationregarding the operational elements disposed in the function dispositionregion is produced, in which the continuously touched operationalelement is produced to be visually distinguishable from the rest of theoperational elements, and a wireless connection to the external displayapparatus is established to cause the produced operational elementdisposition information to be displayed on the external displayapparatus, and in response to a pressure applied on the one of theoperational elements detected by the pressure sensor, the processassigned to the one of the operational elements is started.
 19. Theportable electronic apparatus according to claim 18, further comprisingan additional display device superposed on the handwritten informationinputting device, wherein the additional display device is configured todisplay the function disposition region including the operationalelements.
 20. The portable electronic apparatus according to claim 19,wherein the handwritten information inputting device is superposedrelative to a front face, a rear face, or a side face of the additionaldisplay device.
 21. The portable electronic apparatus according to claim19, wherein the additional display device displays the operationalelements disposed in the function disposition region as graphic icons.22. The portable electronic apparatus according to claim 18, wherein theinformation processing device includes: (a) an image production circuitconfigured to produce an image based on the handwritten informationinputted in the handwritten information inputting region and based on anoperation of any of the operational elements disposed in the functiondisposition region, and (b) a wireless connection circuit configured toestablish a wireless connection with the external display apparatus. 23.The portable electronic apparatus according to claim 22, wherein theinformation processing device further includes a wireless connectionconfirmation circuit configured to confirm whether it is possible toestablish a wireless connection with the external display apparatus. 24.The portable electronic apparatus according to claim 23, wherein, if itis confirmed by the wireless connection confirmation circuit that it ispossible to establish a wireless connection with the external displayapparatus, the information processing device acquires information on ascreen aspect ratio of the external display apparatus, and determines afirst region on the external display apparatus to display theoperational element disposition information regarding the operationalelements relative to a second region on the external display apparatusto display the inputted handwritten information.